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(54) TiUe: WEB REQUEST BROKER CONTROLLING MULTIPLE PROCESSES 



A web server configured to respond to client requests over a network 
such as the World Wide Web includes a web listener having a Hypertext 
Transfer Protocol (HTTP) daemon, a plurality of extension programs 
configured to perform respective operations, and a web request broker 
configured to identify one of the programs for responding to a client 
request, and determine the availability of an instance of the identified 
program. The web request broker maintains control of multiple instances 
of each server extension program to provide enhanced server operation 
without overwhelming server resources. The web request broker maintains 
a minimum number of instances of the identified program in memory, each 
executed in its own address space. The web request broker determines 
whether an available instance of the identified program is available from 
an existing number of instances, and selectively initiates a new instance of 
the program if no other instance is available. If no instance is available and 
the existing number of instances exceeds the maximum prescribed number, 
then the web request broker returns the reply to the web listener to send a 
reply over the network that the request was not processed. 
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WEB REQUEST BROKER CONTROLLING MULTIPLE PROCESSES 



FIELD OF THE INVENTION 

This invention relates to server architectures in networked computer systems, more 
specifically to web servers executing server applications supporting dynamic operations for 
web users. 

5 BACKGROUND OF THE INVENTION 

The World Wide Web includes a network of servers on the Internet ( ,! web servers"), 
each of which has one or more HTML (Hypertext Markup Language) pages. The HTML 
pages on a web server provide information and hypertext links to other documents on that 
and (usually) other web servers. Web servers communicate with clients by using the 
1 0 Hypertext Transfer Protocol (HTTP). 

Users of the World Wide Web use a client program, referred to as a browser, to 
request, decode and display information from a selected web server. When the user of a 
browser selects a link, a request is sent over the Internet to the web server that stores 
information specified in the link. In response to the request, the web server transmits the 
15 specified information to the browser that issued the request. The browser receives the 

information, presents the received information to the user, and awaits the next user request. 

Traditionally, the information stored on web servers is in the form of static HTML 
pages. Static HTML pages are created and stored at the web server prior to a request from a 
web browser. In response to a request, a static HTML page is merely read from storage and 
20 transmitted to the requesting browser. Currently, there is a trend to develop web server 
applications that respond to browser requests by performing dynamic operations. For 
example, a web server may respond to a request by issuing a query to a database, 
dynamically constructing a web page containing the results of the query, and transmitting the 
dynamically constructed HTML page to the requesting browser. To perform dynamic 
25 operations, the functionality of the web server must be enhanced or augmented. Various 
approaches have been developed for extending web servers to support dynamic operations. 

One approach to the provide dynamic operations in response to requests from web 
browsers uses the common gateway interface (CGI). CGI is a specification for transferring 
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information between a web server and a CGI program. A CGI program is any program 
designed to accept and return data that conforms to the CGI specification. The program could 
be written in any programming language, including C, Perl, or Visual Basic. 

The CGI approach suffers from the disadvantage that a separate process (a separate 
5 instance of the CGI program) is initiated each time the specified request is received by the 
server. Receipt of a thousand such requests from different users will thus cause a thousand 
processes to be initiated, exhausting available resources on the server 

An alternative approach to providing dynamic responses to requests involves using a 
"plug-in" extensions. A plug-in extension intercepts messages sent to the server at various 
1 0 stages to perform application-specific processing for a specific user request. A web server 
plug-in executes in the same address space as the web server and all other web server plug- 

4ns. -Hence, an application-developer-designing a plug-in must be familiar with the"lower 

level operational details of the web server. Moreover, execution of the plug-ins in the same 
address space as the web server exposes the web server to security and stability risks, where 
1 5 a faulty plug-in may cause other plug-ins or the web server itself to crash, or perform in an 
unpredictable manner. 



SUMMARY OF THE INVENTION 

There is a need for an arrangement that enables web servers to support dynamic 
20 server operations, where multiple external processes may be initiated, managed, and 
terminated in a controllable, scalable and efficient manner. 

f There is also a need for an arrangement for responding to a client request issued to a 
web server executing multiple instances of a program configured to process the request, 
where the request from the client is selectively dispatched to an available instance. 
25 There is also a need for an arrangement that responds to a client request, where an 

instance of a program configured to process the request is selectively initiated based on the 
availability of existing instances and a predetermined maximum number of instances. 

These and other needs are attained by the present invention^ where a web request 
broker controls processing of a request by identifying a program that corresponds to the 
30 request, selectively initiating an instance of the program, and dispatching the request to the 
instance to process the request. 
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According to one aspect of the present invention, a request issued to a server from a 
client over a network system is processed by obtaining the request over a network, and 
identifying a program that corresponds to the request. An instance of the program is 
selectively initiated based on a prescribed number of instances of the program. The request 

5 is dispatched to the initiated instance of the program, and the instance executes the 

corresponding program to>process the request. The request is then responded to, based on 
the execution of the instance. Hence, a plurality of programs, for example server extensions, 
may be added to a server process in a controllable manner. Moreover, the selective initiation 
of an instance of an identified program ensures that the server maintains control of the 

1 0 multiple instances, preserving stability in server operations. The prescribed number of 

instances may also specify both a minimum and a maximum number of instances, enabling 
processing delays to be minimized by maintaining at least a minimum number of instances in 
memory for subsequent requests, while maintaining control of server resources by limiting ~ 
the maximum number of instances. 

15 According to another aspect of the present invention, a method for execution by a 

server is configured to respond to a request for performance of an operation. The method 
includes obtaining the request over a network, and forwarding the request to a dispatcher 
plug-in executed by the server. The request is processed by causing the dispatcher plug-in to 
determine whether an available instance of a program, configured to handle the request, is 

20 available from an existing number of the program instances. If an instance is available, then 
the request is dispatched for execution by the available instance. If no instance is available, 
then a new instance is initiated if the existing number of instances does not exceed a 
maximum prescribed number. If no instance is available and the existing number of 
instances exceeds the maximum prescribed number^ then a reply is sent over the network 

25 indicating the request was not processed. Hence, the dispatcher plug-in manages server 
resources in processing the request by selectively dispatching the request for execution or 
denying the request based upon the availability of an instance relative to the maximum 
prescribed number of instances. 

Hence, the present invention enables a plurality of extension programs to be added to 

30 a server process in a controllable manner. The dispatcher plug-in controls execution of 

different extension programs running in separate and independent instances, and selectively 
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routes requests to available instances, ensuring that the server process and the server 
extension programs are not overloaded. 

Additional obj ects, advantages and novel features of the invention will be set forth in 
part in the description which follows, and in part will become apparent to those skilled in the 
5 art upon examination of the following or may be learned by practice of the invention. The 
objects and advantages of the invention may be realized and attained by means of the 
instrumentalities and combinations particularly pointed out in the appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 The present invention is illustrated by way of example; and not by way of limitation, 

in the figures of the accompanying drawings in which like reference numerals refer to similar 

_. _ elements and in_which: ._ ' :■ „_.._:_• : ±_ _ _ 

Figure 1 is a block diagram of a web server responding to a request- received from a 
client over a network system, according to an embodiment of the present invention; 
1 5 Figure 2 is a block diagram of the web server according to a first embodiment of the 

present invention; 

' Figures 3 A and 3B are flow diagrams summarizing the method for responding to the 
client request according to an embodiment of the present invention; 

Figure 4 is a flow diagram illustrating a method of initiating the server process 
20 according to an 1 embodiment of the present invention; arid ' 

Figure 5 is a block diagram illustrating the web request broker according to a second 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
25 A method and apparatus for responding to a request issued to a server from a client 

over a network system is described. In the following description, for the purposes of 
explanation, numerous specific details are set forth in order to provide a thorough 
understanding of the present invention. It will be apparent, however, to one skilled in the art 
that the present invention may be practiced without the specific details. In other instances, 
30 well-known structures and devices are shown in block diagram form in order to avoid 
unnecessarily obscuring the present invention. 
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OVERVIEW OF WEB SERVER ARCHITECTURE 
Figure 1 is a diagram of a web server responding to a request received from a client 
over a network system according to an embodiment of the present invention. The web server 
'10 receives the request from a client 12 over a network system 14, for example the World 
5 Wide Web using Transmission Control Protocol/Internet Protocol (TCP/IP). The web server 
10 includes a web listener 16, a web request broker 18, and a plurality of server extension 
programs 20. A user of the network 14 uses the client program 12 to request, decode and 
display information from the web server 10. The client program 12 includes a web browser 
22 that sends a request to the web listener 16 via the network 14. The client program also 

10 includes browser extension programs 24 (e.g., "plug-in" extensions) that provide additional 
processing capabilities for the web browser 22. Communication between the web browser 
22 and the web listener 16 is executed using standardized protocol, for example Hypertext 
Transfer Protocol (HTTP), Version 1 .0. The HTTP 1.0 protocol may be used with optional 
secure sockets layer (SSL) based data-encryption to establish a short-term connection 

15 between the web browser 22 and the web listener 16. 

As described below, the web listener 16 receives the client request over the network 
14, and forwards the request to the web request broker 18. The web request broker 18 
selectively dispatches the request to an executable instance of one of the server extension 
programs 20 for processing. The web listener 16, upon receiving a reply from the web 

20 request broker 18, outputs the reply to the client request via the network 14. Upon receiving 
the reply, the web browser 22 determines the type of request received, and determines how to 
handle the response. For example, the response may either be processed natively by the web 
browser 22, or the web browser 22 may use one of the browser extension programs 24 for 
further processing. The browser extension programs 24 will typically be implemented as a 

25 client-side plug-in that performs specific processing of the reply. Upon completing the 

processing, the client 12 will typically display the result in the web browser's main viewing 
area as a hypertext mark-up language (HTML) page. 



WEB REQUEST BROKER 
30 According to the present invention, web request broker 18, is configured to manage 

processing of client requests by selectively routing the client request to server extensions 
running in separate processes. 
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Figure 2 is a block diagram of the server 10 according to a first embodiment of the 
present invention. The web listener 16 includes an HTTP daemon 16a that supports network 
transport according to HTTP protocol. The web listener 16 receives the client request from 
the network 14, typically delivered in the form of a Uniform Resource Locator (URL). The 
5 client request serves as an identifier for a web object, for example an HTML page or an 
operation to be performed. The web listener 16 hands off the client request to the web 
request broker 1 8 without any attempt at interpreting the client request. 

- The web request broker 1 8 includes a dispatcher plug-in 30 and a plurality of 
execution engines 32. The web request broker 1 8 controls processing of the client request by 
identifying an extension program 20 configured to process the client request, and dispatching 
the client request for execution by an available instance of the extension program. The 

_ dispatcher plug-in 30 .includes a configuration Jibrary 34 that identifies the available- 

programs for handling different requests, described in detail below: Once the dispatcher 
plug-in 30 identifies a program extension 20 that is configured to process the request, the 
dispatcher plug-in 30 determines whether an available instance of the program configured to 
handle the request is available, and dispatches the request for execution by the available 
instance, described below. 

The web server 1 0 also includes a plurality of server extension programs 20a, 20b 
and 20c. Each server extension program, also referred to as a system cartridge, is configured 
for a different operation. Specifically, a server extension program is configured as a 
cartridge that performs a well-defined function, or as a programmable cartridge that acts as 
an interpreter or a routine environment for an application. An example of a programmable 
cartridge is a PL/SQL agent 20a, configured to process database queries according to the 
Oracle-based Programming Language using Structured Query Language (PL/SQL). The 
PL/SQL agent 20a executes a client request having a database query by executing an 
individual process 36 (i.e., a separate instance of the PL/SQL agent 20a). Execution of the 
instance 36a causes the instance to process the request, for example accessing a database 
server 40 in communication with the instance 36 via a data link 42. 

Another example of a programmable cartridge-type server extension program is a 
JAVA interpreter 20b, which enable web application developers to write server-side JAVA 
applications to process client requests. Similarly, a custom server 20c may be configured as 
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an extension program in order to provide dynamic operations, for example accessing 
processes executed by a third party server 46: 

The extension programs 20a, 20b, and 20c, stored as executable code, are executed 
by first initiating an instance 36 of the corresponding extension program 20 into server 
memory, and executing the instance. An instance is equivalent to a process in a UNIX 
environment. The web request broker- 18 manages the execution of each of the extension 
programs 20 by initiating a predetermined minimum number of instances 36a, 36b, 36c for 
the exiension programs 20a, 20b, 20c, respectively. If the web request broker 18 receives a 
client request and determines; that no instance 36 of the appropriate extension program is 
available, the web request broker 18 will initiate a new instance of the program to execute 
the request if the existing number of instances does not exceed a maximum prescribed 
number. - 

v for example, if a client request specifies a request for access of the database 40, the 
web request broker 18 will identify the PL/SQL agent 20a as the program configured to 
handle the request. The web request broker 18 will determine whether an existing instance 
36a of the prouram 20a is available to handle the request. If no instance is available, e.g., all 
the existing instances 36a,-36a„ are processing other client requests, the web request broker 
18 will initiate a new instance 36a ll+I if the existing number of instances 36a does not exceed 
a maximum prescribed number. 

. As shown in Figure 2, the web request broker 18 includes web request broker 
execution crimes (WRBX) 32 for each of the extension programs 20. The execution engine 
32 controh execution of the instances of the corresponding program by providing an 
applicant »n programming interface (WRB API) that specifies predetermined operations to be 
performed by the instances of the corresponding program. By establishing basic callback 
function hct w cen the execution engine 32 and an extension program, any extension program 
can Kr in: -c ruled into the server 10 by configuring the extension program to respond to the 
callKu k t turns (for example an initialization function, a request handler, and a shutdown 
funcuo: i 4*k! then registering the extension program in the configuration library 34, 
descr :?v i ty:k>w . . . 

I hu v 1 1" the dispatcher plug-in 30 determines that the PL/SQL agent 20a is the 
appropnau exiension to process a request, the dispatcher plug-in 30 dispatches the request to 
the execution engine 32a. If a new instance of the program 20 needs to be initiated, the 
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dispatcher plug-in 30 creates a new instance of the program in a separate address space and 
dispatches the request to. the execution engine 32a of the new instance. The address space 
used to execute the instance of the program may be within memory of the computer system 
upon which the web request broker is executing, or on another computer system. The 
5 execution engine 32a then issues a request handler callback function to the specified instance 
36a,, causing the instance 363, to process the request, for example by accessing the database 
40. The instance 36a, executing the request returns the result to the execution engine 32a, 
which forwards the result to the dispatcher plug-in 30. In the event that the web request 
broker 18 detects a fault in the operation, the execution engine 32a issues a shutdown 
10 function to abort the instance from memory. 

Hence, the execution engine 32a provides an application programming interface to 

theweb request broker 18 (WRB API) that specifies predetermined operations to be 

performed. Use of the WRB API enables programmers of the extension programs 20 to 
configure each extension program for high-level integration into the server 10 independent of 

15 the protocols used by the particular web listener with which the extension program will be 



20 



25 



used. 



Figures 3A and 3B summarize a flow diagram illustrating a method of responding to 
the client request according to an embodiment of the present invention. The client request is 
received in step 50 by the web listener 16. Upon receiving the client request, the web 
listener 16 forwards the request to the web request broker 18 in step 52. The dispatcher plug- 
in 30 identifies the program that corresponds to the client request by accessing in step 54 the 
configuration library 34, The configuration library 34 includes for each program an object 
type corresponding to the request processed by the corresponding program. For example, if 
the client request is a URL request beginning with.the virtual path "/Java", the configuration 
library 34 will store a corresponding object specifying that the JAVA interpreter 36b is 
configured to handle requests having the virtual path "/java". The configuration library 34 
will also include a virtual path specifying an address location for the stored program used to. 
. initiate instances of the program 20. 

The dispatcher plug-in 30 determines in step 56 if the request object type (e.g., the 
30 virtual path specified in the client request) corresponds to an identifiable program, where the 
request object type corresponds to an object type stored in the configuration library 34. If the 
request object type does not correspond to an identifiable program, the request is returned to 
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the web listener 16 in step 58 (see Figure 3B). If in step 58 the HTTP daemon 16a 
recognizes the request as a request for a static HTML page, the HTTP daemon accesses the 
static HTML page from the page memory 16b, and sends the reply to the client in step 60. If 
the client request is not recognized by the HTTP daemon, the reply is sent to the client in 
5 step 60 indicating that the request was unrecognizable. 

If in step 56 the dispatcher plug-in 30 identifies from the configuration library 34 an 
extension program configured to handle the request, the dispatcher plug-in 30 determines in 
step 62. shown in Figure 3B, whether an available instance of the identified program is 
available among the existing number of instances 36. If in step 62 the dispatcher plug-in 30 

10 identifies an available instance, for example instance 36a2 of the PL/SQL agent 20a, the 
corresponding execution engine 32 is called in step 68 to execute the available instance to 
process the request, described below. However, if in step 62 no instance of the identified 
program 20 is available, the dispatcher plug-in 30 determines in step 64 if the existing 
. number of instances exceeds a maximum prescribed number, stored in the configuration 

15 library 34 ; If the existing number of instances exceeds the maximum prescribed number in 
step 64 T the dispatcher plug-in 30 returns the request to the web listener 16 in step 58, after 
which the web listener sends a reply to the client over the network in step 60 indicating the 
request was not processed. 

If in step 64 the existing number of instances does not exceed the maximum 

20 prescribed number, the dispatcher plug-in 30 initiates a new instance of the identified 

program and dispatches the request to the execution engine 32a of the new instance. For 
example, the dispatcher plug-in 30 initiates a new instance of the PL/SQL agent 20a. During 
this step, the stored sequences of instructions for the PL/SQL agent 20a are accessed to 
create a new instance 36% of the program 20a in an .address space that is separate from the 

25 address space in which dispatcher plug-in 30 is executing. 

Once the new instance 36% is running, the dispatcher plug-in 30 dispatches the 
request to the execution engine 32a associated with the new instance 36% in step 68. The 
execution engine 32a sends a callback message to the new instance 36a^ requesting execution 
of the request. The execution engine 20 passes in the callback message any parameters 

30 necessary for the instance 36% to process the request, for example passwords, database 

search keys, or any other argument for a dynamic operation executed by the instance 36a;. 
The instance 36aj then executes the request. During the execution of the request by the 

9 

SUBSTITUTE SHEET ( rule 26 ) 

BNSDOCID: <WO 9834386A1_I_> 



WO 98/34386 



PCT/US98/01644 



instance in step 68, the dispatcher plug-in 30 monitors the instance to determine the 
occurrence of a fault in step 70. If in step 70 the dispatcher plug-in 30 detects a fault, the 
dispatcher plug-in 30 calls the corresponding execution engine 32 in step 72 to abort the 
instance 36 having the fault. The corresponding execution engine 32 in turn issues a shut 
down command across the API to the faulty instance. The instance, responding to the shut 
down command by the execution engine 32, will shut down without affecting any other 
process in any other address space. . , ... 

I f in step 70 no fault is detected, the dispatcher plug-in 30 receives a reply from the 
instance 36 upon completion of execution in step 74. The dispatcher plug-in 30 in step 76 
forwards the reply to the web listener 16, which responds to the client with the reply from the 
executed instance 36. After executing the instance, the dispatcher plug-in 30 in step 78 

. Pl a !'l , i 1 L n . s _ thc _ in ? t . a ?ce !_in _the memory, as. shown.in step .78-to enable execution of a - 

subsequent request. 

Hence, the disclosed arrangement manages multiple instances of different extension 
programs to process a variety of user requests. Each instance 36 for any program 20 is 
executed m a separate memory space, enabling a faulty instance 36 of a program 20 to be 
aborted w ithoui affecting any other instances of the programs. The web request broker 1 8 
also controls the number of instances for each given extension program 20. Hence, server 
resources jre controlled to ensure that a large number of requests do not overwhelm the 
server |o b\ an uncontrollable generation of instances. Execution throughput also is 
imprtn ed h> maintaining a minimum number of instances ready for execution. Moreover, 
addmpr-.u: instances may be. initiated and maintained in memory for executing subsequent 
requests, a v opposed to terminating an instance after a single execution and then reloading 
the cxKn-.^n program into memory in.order to recreate an instance for execution of a 
subscqucn! request. ■ 

f uixrc 4 is, a diagram illustrating the initialization of the server 10 according to an 
emrxxhnu H! of the present invention. The server 10 is initialized by starting the server 
process t '*>. where the web listener and supporting processes are loaded into memory 
space ! ; u v, t \ er 10 then starts the dispatcher plug-in 30 in step 92, causing the sequences 
of instru.t i >n tor executing the web request broker 18 to be stored in memory. The 
extcns.or programs 20 are then registered with the dispatcher plug-in 30 in step 94 by storing 
in the colouration library 34, for each extension program 20: (1) the cartridge name; (2) the 
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minimum number of required instances 36; (3) the maximum number of instances; (4) the 
virtual path for accessing the extension program, i.e., the address space to be accessed to 
initiate a new instance of the program; (5) the program-dependent function names used by 
the execution engine to execute the callback functions (initialization, request handler, 

5 shutdown); and (6) an object identifier, for example an object type to be supplied by a client 
request for requesting performance" of an operation by the corresponding extension program 
20. The object type may be a specific word, or may include a virtual path, for example 
"/java". The extension programs 20 may be registered in step 94 by a server manager, i.e., a 
web master having access to the configuration library in a real-time user-interactive 

1 0 environment. Once the server manager has established the configuration library, the 

extension programs may be registered in step 94 automatically by accessing a non-volatile 
memory, for example a disk. 

After registering the extension programs with the dispatcher plug-in 30, the 
* dispatcher plug-in 30 initiates the minimum instances for each program in a separate address 

1 5 space in step 96. , Once the minimum number of instances has been initiated, the server 10 is 
prepared to process client requests. Each execution engine 32 tracks the location in memory 
and status of each instance 36 of the corresponding program 20. 

Figure 5 is a block diagram of the server 10, according to a second embodiment of 
the present invention. The first embodiment of Figure 2 assumes that the dispatcher plug-in 

20 30 is compatible with the lower level processes of the web listener 16 and the HTTP daemon 
16a. The embodiment of Figure 5 is a modification of the first embodiment of Figure 2, in 
that the server includes a transport adapter 17 that receives a client request from the HTTP 
daemon 16' operating according to a protocol different from the web request broker 18. 

The transport adapter 1 7 is configured to recognize the protocols of different HTTP 

25 daemons, and can convert the client requests received from the HTTP daemon 16* into a 
converted client request having a second protocol independent from the protocol of the 
HTTP daemon 16' and matching the protocol of the web request broker 1 8. Hence, the 
transport adapter 17 enables the web request broker 18 to be used with HTTP daemons from 
different vendors. Moreover, transport adapter 17 may be configured to accommodate 

30 different server architectures and operating systems. Hence, the transport adapter 17 
converts a client request from the HTTP daemon 16 f from a first protocol to a second 
protocol compatible with the web request broker 18. Similarly, replies from the web request 
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broker are converted to the transport protocol of the HTTP daemon 16' to enable the HTTP 
daemon 16' to send the reply to the user via the network; 

In the foregoing specification, the invention has been described with reference to 
specific embodiments thereof. It will, however, be evident that various modifications and 
changes may be made thereto without departing from the broader spirit and scope of the 
invention. The specification and drawings are, accordingly, to be regarded in an illustrative 
rather than restrictive sense. 
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What is claimed is: 



1 1 . A method for responding to a request issued to a server from a client over a 

2 network system, the method comprising the steps of: 

3 obtaining the request over a network; 

4 identifying a program that corresponds to the request; 

5 selectively initiating an instance of the program based on a prescribed number of 

6 instances of said program; 

7 dispatching the request to said instance of said program; 

8 executing said instance to cause said instance to process said request; and 

9 responding to the request based on execution of said instance. 

1 2. The method of Claim 1, wherein: 

2 the step of obtaining the request over a network is performed by a server process 

3 executing in a first address space; 

4 the step of selectively initiating an instance of the program includes initiating said 

5 instance in a second address space that is separate from the first address space. 

1 3. The method of Claim 1 , further comprising the step of, after executing said 

2 instance, maintaining said instance in memory for executing a subsequent request. 

1 4. The method of Claim 1, further comprising the steps of: 

2 detecting a fault in the instance during execution thereof; and 

3 aborting the instance in response to detecting said fault. 

1 5. The method of Claim 1, wherein the prescribed number of said instances specifies 

2 at least one of a maximum and a minimum number of instances, wherein each instance 

3 executes within an address space that is separate from the address spaces used by other 

4 instances of said program. 
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1 6. The method of Claim 5, wherein: 

2 the step of selectively initiating an instance of the program includes the step of 

3 initiating a specified minimum number of instances of said program prior to obtaining the 

4 request over the network; and 

5 the method further includes the step of, after obtaining the request over the network, 

6 determining if one of the minimum number of instances is available for processing said 

7 request. i 

1 7. The method of Claim 6 further including the step of, after obtaining the request 

2 over the network, initiating a new instance of the program if none of the minimum number of 

3 instances is available for processing said request and the number of instances is less than the 

4 maximum number of instances. 



1 8. The method of Claim 6, wherein the step of executing said instance includes 

2 executing an available instance from the minimum number of instances. 

1 9. The method of Claim 1 , wherein the step of selectively initiating an instance of 

2 the program includes the step of returning the request to the network without processing said 

3 request based on the prescribed number of said instances exceeding a maximum value. 

1 10. The method of Claim 1 further comprising the step of registering a plurality of 

2 programs with the server, wherein registration of each of said programs includes specifying a 

3 maximum number of instances for said program, and a virtual path for said program. 

1 11. The method of claim 10, wherein: 

2 the .request identifies a virtual path; and 

3 -the step of identifying a program that corresponds to the request includes the step of 

4 identifying the program based on the virtual path identified in the request. 

1 : , 12. The method of Claim 1, wherein: 

2 the step of obtaining the request over a network comprises receiving the request from 

3 a transport protocol process operating according to a first protocol; and 
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4 the method includes the step of converting the request to a second protocol 

5 independent from the first protocol. 

1 13. A method, for execution by a server, for responding to a request for performance 

2 of an operation, the method comprising: . 

3 obtaining the request over a network; 

4 forwarding the request to a dispatcher executed by the server; and 

5 processing the request by causing the dispatcher to perform the steps of: 

6 A) determining whether an available instance of a program configured to handle the 

7 request is available among an existing number of instances of the program, 

8 B) if an available instance is available, then dispatching the request for execution by 

9 the available instance, 

10 C) if no instance is available, then initiating a new instance of the program for 

1 1 execution of the request if the existing number of instances does not exceed a maximum 

12 prescribed number, and 

13 D) if no instance is available and the existing number of instances exceeds the 

14 maximum prescribed number, then sending said reply over the network indicating the 

15 request was not processed. 

1 14. The method of Claim 13, further comprising the step of: 

2 receiving, by the dispatcher, a reply from the instance executing the request; and 

3 sending information contained in the reply over the network from the dispatcher to a 

4 client that issued the request. 

* 1 15. The method of Claim 13, further comprising the step of: 

2 detecting by the dispatcher a fault in the instance executing the request; and 

3 terminating by the dispatcher the instance executing the request in response to the 

4 detected fault. 

1 16. The method of Claim 1 5 , further comprising the step of sending a reply over the 

2 network indicating the request was not processed. 
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1 1 7. The method of Claim 1 3 , further comprising the step of registering with the 

2 dispatcher a plurality of programs configured to handle respective types of requests, the step 

3 of registering with the dispatcher a plurality of said programs including the step of storing in 

4 the dispatcher for each of said programs a maximum number of instances and a virtual path 

5 specifying an address location associated with the corresponding program. 

1 1 8. The method of Claim 13, wherein each instance is executed within an address 

2 space that is separate from the address spaces used by other instances of said program. 

1 19 . The method of Claim 18, wherein me step ofinitiating a new instance of the 

2 program comprises the step of initiating the new instance within an address space that is 

3 separate from the address spaces used by the other instances of said program. 

1 20. The method of Claim 19, further comprising the step of delaying deallocation of 

2 said new instance at least a predetermined time interval after processing the request for 

3 processing a subsequent request. 

1 21. The method of Claim 13, wherein: 

2 the step of obtaining the request over the network comprises receiving the request 

3 from a transport protocol process operating according to a first protocol; arid 

4 the method further comprises the step of converting the request to a second protocol 

5 independent from the first protocol. 

1 22. The method of Claim 1 3, wherein the existing number of said instances is at least 

2 a prescribed minimum number of said instances. 

3 , ■ . 

1 23. The method of Claim 1 3, further comprising the steps of: 

2 causing the dispatcher to determine if a program is configured to handle the request 

3 based on the operation specified in the request; and 

4 if no program is configured to handle the request, then sending a reply over the 

5 network indicating the request was not processed. 
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1 24. The method of Claim 13, wherein: 

2 the step of obtaining the request over the network comprises the step of executing by 

3 * the server a server process; and 

4 the step of processing the request by causing the dispatcher to perform said steps 

5 comprises the step of executing by the server a plug-in routine, added to the server process, 

6 to cause the dispatcher to perform said steps. 

1 25. A computer readable medium having stored thereon sequences of instructions for 

2 responding to a request for performance of an operation received by a server, the sequences 

3 of instructions including instructions for performing the steps of: 

4 obtaining the request over a network; 

5 identifying a program that corresponds to the request; 

6 selectively initiating an instance of the program based on a prescribed number of 

7 instances of said program; 

8 dispatching the request to said instance of said program; 

9 executing said instance to cause said instance to process said request; and 
10 responding to the request based on execution of said instance 

1 26. The computer readable medium of Claim 25, further comprising sequences of 

2 instructions for performing the steps of: 

3 detecting a fault in the instance during execution thereof; and 

4 aborting the instance in response to detecting said fault. 

1 27. The computer readable medium of Claim 25, wherein the prescribed number of 

2 said instances specifies at least one of a maximum and a minimum number of instances, 

3 wherein each instance executes within an address space that is separate from the address 

4 spaces used by other instances of said program. 

1 28. A computer server configured to respond to a request for performance of an 

2 operation, comprising: 
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3 a network listener configured to receive the request over a network and send a 

4 response to the request over the network, the request having a prescribed object type 

5 specifying an operation to be performed; 

6 a plurality of programs, each program configured to perform an operation that 

7 generates an output in response to receiving a request having a corresponding object type 

8 specifying the operation performed by the program, each program having a prescribed 

9 number of instances executing at respective address spaces; and 

10 a dispatcher plug-in configured to identify one of the programs for responding to the 

1 1 request based on the prescribed object type, the dispatcher plug-in selectively dispatching the 

12 request to an available instance of the identified one program based upon the corresponding 

13 prescribed number of instances, the dispatcher plug-in sending said response to the network 

14 listener based on execution of the request by the available instance. 

1 29. The server of Claim 28, wherein the network listener receives and sends the request and 

2 the response based on Hypertext Transfer Protocol (HTTP). 

1 30. The server of Claim 29, wherein the network listener includes an HTTP daemon 

2 configured to output a static Hypertext Markup Language (HTML) page in response to the 

3 prescribed object type specifying sending said static HTML page. 

1 31. The server of Claim 28, further comprising a transport adapter configured to 

2 convert the request received by the network listener from a first protocol to a second protocol 

3 independent from the first protocol, the transport adapter converting the response output by 

4 the dispatcher plug-in from said second protocol to the first protocol before sending by the 

5 network listener. 



1 32. The server of Claim 28, further comprising a plurality of execution engines, each 

2 execution engine configured to control execution of the instances of the corresponding 

3 programs and provide an Application Programming Interface (API) specifying 

4 predetermined operations to be performed by the instances of the corresponding program, the 

5 execution engine corresponding to the identified one program receiving the request from the 

6 dispatcher plug-in and controlling execution of the available instance processing the request. 
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1 33. The server of Claim 32, wherein the predetermined operations specified by the 

2 API includes at least one of initialization, execution of the request, and shutdown by at least 

3 one of the instances of the corresponding program. 

1 34. The server of Claim 28, wherein each execution engine initiates a prescribed 

2 minimum number of said instances of the corresponding program. 

1 35. The server of Claim 28, wherein the dispatcher plug-in includes a configuration 

2 library identifying for each of the programs the corresponding object type and the prescribed 

3 number of instances. f 

36. The server of Claim 28, wherein the object type of the request includes a virtual 

5 path specifying the identified one program. 
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Send Reply to Client 
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Start Server Process 



92 

Start Dispatcher Plug-in 



94 

Register Extension Programs 
(Min, Max, Virtual Path, Object type) 



96 
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